MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
Identifieur interne : 000094 ( Istex/Checkpoint ); précédent : 000093; suivant : 000095MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
Auteurs : Iadine Chadès [Australie] ; Guillaume Chapron [Suède] ; Marie-Josée Cros [France] ; Frédérick Garcia [France] ; Régis Sabbadin [France]Source :
- Ecography [ 0906-7590 ] ; 2014-09.
Abstract
Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.
Url:
DOI: 10.1111/ecog.00888
Affiliations:
Links toward previous steps (curation, corpus...)
Links to Exploration step
ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911CLe document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><author><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name></author><author><name sortKey="Chapron, Guillaume" sort="Chapron, Guillaume" uniqKey="Chapron G" first="Guillaume" last="Chapron">Guillaume Chapron</name></author><author><name sortKey="Cros, Marie Osee" sort="Cros, Marie Osee" uniqKey="Cros M" first="Marie-Josée" last="Cros">Marie-Josée Cros</name></author><author><name sortKey="Garcia, Frederick" sort="Garcia, Frederick" uniqKey="Garcia F" first="Frédérick" last="Garcia">Frédérick Garcia</name></author><author><name sortKey="Sabbadin, Regis" sort="Sabbadin, Regis" uniqKey="Sabbadin R" first="Régis" last="Sabbadin">Régis Sabbadin</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911C</idno><date when="2014" year="2014">2014</date><idno type="doi">10.1111/ecog.00888</idno><idno type="url">https://api.istex.fr/document/5358F5E00125CDBC7C7419D57192ACC07F95911C/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000F71</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Corpus" wicri:corpus="ISTEX">000F71</idno><idno type="wicri:Area/Istex/Curation">000F71</idno><idno type="wicri:Area/Istex/Checkpoint">000094</idno><idno type="wicri:explorRef" wicri:stream="Istex" wicri:step="Checkpoint">000094</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main">MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems</title><author><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name><affiliation wicri:level="1"><country wicri:rule="url">Australie</country></affiliation><affiliation wicri:level="1"><country xml:lang="fr">Australie</country><wicri:regionArea>CSIRO Ecosystem Sciences, GPO Box 2583, QLD 4001, Brisbane</wicri:regionArea><wicri:noRegion>Brisbane</wicri:noRegion></affiliation><affiliation wicri:level="1"><country wicri:rule="url">Australie</country></affiliation></author><author><name sortKey="Chapron, Guillaume" sort="Chapron, Guillaume" uniqKey="Chapron G" first="Guillaume" last="Chapron">Guillaume Chapron</name><affiliation wicri:level="1"><country xml:lang="fr">Suède</country><wicri:regionArea>Grimsö Wildlife Research Station, Swedish Univ. of Agricultural Sciences, Riddarhyttan, SE‐73091</wicri:regionArea><wicri:noRegion>SE‐73091</wicri:noRegion></affiliation></author><author><name sortKey="Cros, Marie Osee" sort="Cros, Marie Osee" uniqKey="Cros M" first="Marie-Josée" last="Cros">Marie-Josée Cros</name><affiliation wicri:level="3"><country xml:lang="fr">France</country><wicri:regionArea>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</wicri:regionArea><placeName><region type="region" nuts="2">Occitanie (région administrative)</region><region type="old region" nuts="2">Midi-Pyrénées</region><settlement type="city">Castanet Tolosan</settlement></placeName></affiliation></author><author><name sortKey="Garcia, Frederick" sort="Garcia, Frederick" uniqKey="Garcia F" first="Frédérick" last="Garcia">Frédérick Garcia</name><affiliation wicri:level="1"><country xml:lang="fr">France</country><wicri:regionArea>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</wicri:regionArea><wicri:noRegion>31326 Castanet Tolosan cedex</wicri:noRegion><wicri:noRegion>FR‐31326 Castanet Tolosan cedex</wicri:noRegion></affiliation></author><author><name sortKey="Sabbadin, Regis" sort="Sabbadin, Regis" uniqKey="Sabbadin R" first="Régis" last="Sabbadin">Régis Sabbadin</name><affiliation wicri:level="3"><country xml:lang="fr">France</country><wicri:regionArea>INRA, Unité de Mathématiques et Informatique Appliquées, Toulouse, UR875, CS 52627, FR‐31326 Castanet Tolosan cedex</wicri:regionArea><placeName><region type="region" nuts="2">Occitanie (région administrative)</region><region type="old region" nuts="2">Midi-Pyrénées</region><settlement type="city">Castanet Tolosan</settlement></placeName></affiliation></author></analytic><monogr></monogr><series><title level="j" type="main">Ecography</title><title level="j" type="alt">ECOGRAPHY</title><idno type="ISSN">0906-7590</idno><idno type="eISSN">1600-0587</idno><imprint><biblScope unit="vol">37</biblScope><biblScope unit="issue">9</biblScope><biblScope unit="page" from="916">916</biblScope><biblScope unit="page" to="920">920</biblScope><biblScope unit="page-count">5</biblScope><publisher>Blackwell Publishing Ltd</publisher><pubPlace>Oxford, UK</pubPlace><date type="published" when="2014-09">2014-09</date></imprint><idno type="ISSN">0906-7590</idno></series></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0906-7590</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Stochastic dynamic programming (SDP) or Markov decision processes (MDP) are increasingly being used in ecology to find the best decisions over time and under uncertainty so that the chance of achieving an objective is maximised. To date, few programs are available to solve SDP/MDP. We present MDPtoolbox, a multi‐platform set of functions to solve Markov decision problems (MATLAB, GNU Octave, Scilab and R). MDPtoolbox provides state‐of‐the‐art and ready to use algorithms to solve a wide range of MDPs. MDPtoolbox is easy to use, freely available and has been continuously improved since 2004. We illustrate how to use MDPtoolbox on a dynamic reserve design problem.</div></front></TEI><affiliations><list><country><li>Australie</li><li>France</li><li>Suède</li></country><region><li>Midi-Pyrénées</li><li>Occitanie (région administrative)</li></region><settlement><li>Castanet Tolosan</li></settlement></list><tree><country name="Australie"><noRegion><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name></noRegion><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name><name sortKey="Chades, Iadine" sort="Chades, Iadine" uniqKey="Chades I" first="Iadine" last="Chadès">Iadine Chadès</name></country><country name="Suède"><noRegion><name sortKey="Chapron, Guillaume" sort="Chapron, Guillaume" uniqKey="Chapron G" first="Guillaume" last="Chapron">Guillaume Chapron</name></noRegion></country><country name="France"><region name="Occitanie (région administrative)"><name sortKey="Cros, Marie Osee" sort="Cros, Marie Osee" uniqKey="Cros M" first="Marie-Josée" last="Cros">Marie-Josée Cros</name></region><name sortKey="Garcia, Frederick" sort="Garcia, Frederick" uniqKey="Garcia F" first="Frédérick" last="Garcia">Frédérick Garcia</name><name sortKey="Sabbadin, Regis" sort="Sabbadin, Regis" uniqKey="Sabbadin R" first="Régis" last="Sabbadin">Régis Sabbadin</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Wicri/Asie/explor/AustralieFrV1/Data/Istex/Checkpoint
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000094 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Istex/Checkpoint/biblio.hfd -nk 000094 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Wicri/Asie
|area= AustralieFrV1
|flux= Istex
|étape= Checkpoint
|type= RBID
|clé= ISTEX:5358F5E00125CDBC7C7419D57192ACC07F95911C
|texte= MDPtoolbox: a multi‐platform toolbox to solve stochastic dynamic programming problems
}}
| This area was generated with Dilib version V0.6.33. |  |